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We develop a way of improving complex Langevin dynamics motivated by the Lefschetz-thimble 
decomposition of integrals. In our method, arbitrary observables of an original model with multiple 
Lefschetz thimbles are computed by a modified model with a single thimble. We apply our mod¬ 
ification method to a one dimensional integral in which the naive implementation of the complex 
Langevin dynamics fails to reproduce the exact results due to the severe sign problem. We show 
that the toy model can be modified so that the new model consists of a single Lefschetz thimble. 
We find that correct results can be obtained by the improved complex Langevin dynamics. 

PACS numbers: 11.15.Ha 


I. INTRODUCTION 

The quantum Monte Carlo simulation is a sophisti¬ 
cated way to reveal nonperturbative physics for theo¬ 
ries with real actions. However, it does not work well 
for theories with complex actions due to the breakdown 
of the interpretation of the Boltzmann factor e~^ as a 
probability distribution. Complex actions are found in 
many fields of physics; frustrated spin systems, the Hub¬ 
bard model away from half filling, QCD at finite chemi¬ 
cal potential and all real time problems. In these cases, 
the quantum Monte Carlo simulation suffers from the 
sign problem which prevents us from measuring physical 
quantities with appropriate precision W- To establish 
first-principle approaches for complex actions is still an 
outstanding problem in physics. 

To circumvent the sign problem, the stochastic quan¬ 
tization is explored to apply theories with complex ac¬ 
tions. The framework of the ordinary stochastic quanti¬ 
zation is established for theories with real actions, where 
a quantum average is computed by solving a Langevin 
equation m- At least formally, the stochastic quanti¬ 
zation seems to be extended to cases with complex ac¬ 
tions [SHU]. However, the complex Langevin dynamics 
sometimes gives incorrect results [13 HD- Recently, a 
necessary and sufficient condition for correctness of the 
complex Langevin dynamics is proposed and a formal 
justification of this method is established [T3IIS1- Nev¬ 
ertheless, it is still difficult to expect a priori when the 
complex Langevin dynamics gives correct answers, al¬ 
though practical methods are proposed to improve it mi- 
ora]. Moreover, there are subtleties when an action in¬ 
volves logarithmic terms. For instance, such a logarith¬ 
mic term comes from a fermionic determinant in QCD at 
finite chemical potential. The logarithmic term leads to 
a singular behavior of a drift term and thus the complex 
Langevin dynamics can fail to give correct results [201122] . 
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Another possible way to overcome the sign problem is 
the Lefschetz-thimble decomposition which is a general¬ 
ization of the steepest descent method. In that frame¬ 
work, an integration path is deformed to a set of curved 
manifolds in a complex space which are called Lefschetz 
thimbles. This method is extended to higher dimen¬ 
sions [23 and directly applied to the quantum field the¬ 
ories [24] . The numerical implementation of this method 
is also discussed extensively [2HH2H] . The method of Lef¬ 
schetz thimbles is well established, but in principle, non- 
holomorphic actions are beyond the scope of this method. 
Nevertheless, for known cases, Lefschetz thimbles are well 
defined for actions with logarithmic terms |36j . The rela¬ 
tion between complex Langevin dynamics and Lefschetz 
thimbles is first discussed in EZl iSEj. It is suggested 
that in some cases configurations sampled by the com¬ 
plex Langevin process can be interpreted as the impor¬ 
tance sampling on Lefschetz thimbles. 

In this paper, we consider the cases where the config¬ 
urations generated by the complex Langevin process are 
sampled on Lefschetz thimbles. In such a case, we point 
out that multi-thimble structure causes the wrong con¬ 
vergence of complex Langevin simulations. We develop a 
way of improving complex Langevin dynamics by modi¬ 
fying a structure of Lefschetz thimbles and demonstrate 
how our approach works by applying it to the cosine 
model which has a severe sign problem due to the loga¬ 
rithmic term in its action analogous to the chiral random 
matrix theory and QCD at finite chemical potential. 

II. COMPLEX LANGEVIN DYNAMICS AND 
LEFSCHETZ THIMBLES 

In this section, we briefly introduce the two frame¬ 
works, complex Langevin dynamics and the Lefschetz- 
thimble decomposition. 

In the ordinary stochastic quantization, it is assumed 
that dynamical variables depend on a fictitious time t and 
satisfy the Langevin equation. Once the system relaxes 
to thermal equilibrium, the noise average is interpreted as 
the quantum average. This framework is formally gener- 
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alized to theories with complex actions. Supposing that 
the action of an original theory is given by S{x), where 
X G M and S{x) G C, the stochastic quantization is ap¬ 
plied by replacing x with z G C. Then, the Langevin 
equation with a complex action S{z) is given by 


dz 


dS{z) 

dz 


( 1 ) 


where 77 is a real Gaussian noise satisfying {r](t)ri{t')) = 
2S{t — t'). {...) indicates the noise average here. 

The other useful framework is the Lefschetz-thimble 
decomposition. Lefschetz thimbles jTo- are defined as the 
paths of steepest descent starting from saddle points of 
the action Zg-, where cr is a label of each saddle point. 
The steepest descent path is determined by the following 
flow equation: 


dz _ /dSiz)\ 
dt \ 9z /' 


( 2 ) 


Note that the saddle point Za is nothing but a fixed point 
of the flow equation. The steepest ascent path start¬ 
ing from the same point as is also determined by a 
similar flow equation whose sign of the gradient term 
is opposite to Eq. ([^. By utilizing the set of Lefschetz 
thimbles, the partition function is decomposed as follows: 

Z= j f 

J CT 

(3) 


The global sign factor jg factorized outside the 

integral since the imaginary part of the action is constant 
along each Lefschetz thimble. Coefficient n^j is the num¬ 
ber of intersections of the original integration path and 
the steepest ascent path K.^. We refer to a Lefschetz 
thimble which has non-zero intersection number as a rel¬ 
evant thimble. 

There are various arguments about relations between 
the complex Langevin dynamics and the Lefschetz- 
thimble decomposition. Some cases are known that the 
complex Langevin simulation is regarded as an impor¬ 
tance sampling on Lefschetz thimbles while the opposite 
cases are also known. In this paper, we consider the 
cases where the configurations generated by the complex 
Langevin process are sampled on Lefschetz thimbles in 
order to identify a cause of wrong convergence problem 
of the complex Langevin simulation from a viewpoint 
of the Lefschetz thimbles. It may be naively expected 
that the complex Langevin dynamics gives correct an¬ 
swers when the importance sampling on Lefschetz thim¬ 
bles is achieved. However, this is neither necessary nor 
sufficient for the correctness of the complex Langevin dy¬ 
namics [13139]. In fact, as we see below, the complex 
Langevin simulation does not give correct answer if there 
are more than two Lefschetz thimbles. 


III. COSINE MODEL 

Let us consider a toy model whose partition function 
is given by the one dimensional integral, 

Z= j dxcosxe^™"". (4) 

This cosine model is obtained by the factorization of the 
two dimensional U(l) model [13]. The action of this 
model reads S = —jdcosx — log(cosx) and it is complex 
due to the logarithmic term when tx 12 < |x| < tt. We 
assume that the parameter /3 is real and positive. The 
expectation value of cos nx can be expressed analytically: 

f ^ dx cos nx cos xe^ ^ 

icosux)^ = --;-T- 

f dx cos xe^ ^ 

J —TT 

nlr^ 

hiP) ^ phipy 

where In{P) is the modified Bessel function of the first 
kind. Note that in n = 1 case, the expectation value 
(cosx)^ diverges as ~ 1/P for /? <C 1. 

Concerning the sign problem, it is instructive to con¬ 
sider this toy model. In fact, the reweighting technique, 
a way to tame the sign problem, does not give correct 
answers for this model since the average phase factor 
(cos(x)/ I cos(x) I) becomes much smaller than 1 as /3 
goes to zero [1 dS]. These behaviors are reminiscent 
of the sign problem in QCD at finite chemical poten¬ 
tial. Moreover, as discussed in Ref. [13], the complex 
Langevin dynamics also fails to reproduce the exact re¬ 
sult Eq. ([^ for the cosine model. (This behavior is also 
found in Eig. |^) In the following, we discuss how the 
sign problem appears in the cosine model for P < 1. 

In Eig. [^ the Lefschetz thimbles and the correspond¬ 
ing steepest ascent paths are denoted by solid and dotted 
lines for P = 0.5. The scattered data are configurations 
sampled by the complex Langevin process. We also il¬ 
lustrate the drift term of the complex Langevin equation 
by arrows. One finds that the configurations seem to be 
well distributed around the relevant thimbles. This re¬ 
sult suggests that the complex Langevin dynamics may 
not work even when an importance sampling on Lefschetz 
thimbles is achieved. To find the origin of the failure we 
focus on the structure of Lefschetz thimbles. 

In the cosine model, there exist four fixed points Zf = 
0, TT and TT ± f cosh“^(l//3), while only the two thimbles 
starting from Zf = 0 and tt contribute to the partition 
function Eq when P < 1. The values of the action 
on these fixed points are 5'(0) = —/3 and S{Tr) = P — in. 
Decreasing P, the real parts of these values come close, 
and then, the contribution from each thimble should can¬ 
cel out. This situation is referred to as the global sign 
problem in the context of the method of Lefschetz thim¬ 
bles. Despite the cancellation of multi-thimble contribu¬ 
tion should be crucial to reproduce correct results [52] - 
complex Langevin processes do not take into account the 
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FIG. 1. Lefschetz thimbles and sampled configurations of 
the original (upper panel) and the regular (lower panel) cosine 
models for /3 = 0.5. Solid (dotted) lines are steepest descent 
(ascent) paths. Arrows denote the drift term of Eq. 0. 
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phase factor automatically [201110]. Figure]^ 

shows the histogram of configurations sampled by the 
complex Langevin process for ^ = 0.5. Each configura¬ 
tion holds Imz ~ 0, which means that all sampled points 
are contained in the Lefschetz thimbles. The histogram 
has two peaks around z = 0 and tt, and its shape is char¬ 
acterized by the distribution P(x) oc without 

any information of the imaginary part of the action. This 
can spoil the validity of the complex Langevin processes. 

The interesting feature of the cosine model is that 
we can improve the complex Langevin process so that 
it gives correct answers m- Recalling that the par¬ 
tition function Eq. Q is invariant by adding 0 = 
i dx sin ^, one finds 

Z= f (6) 

J —TT 

which is equivalent to Eq. Q. The action obtained from 
the new expression reads 5'reg = —/? cos x — ix which does 
not involve logarithmic singularities. We refer to this 
model as the regular cosine model. The lower panel of 





FIG. 2. The distribution of the original cosine model ob¬ 
tained by the complex Langevin process for /3 = 0.5. The 
solid line indicates the distribution function P{x) oc 


Fig.[T] shows the Lefschetz thimbles of the regular cosine 
model for = 0.5. We find that the original integration 
path is deformed to the single Lefschetz thimble and the 
configurations sampled by the complex Langevin process 
are well distributed around it. In contrast to the original 
cosine model, the phase factor ) does not matter 

for the regular cosine model since it consists of only one 
Lefschetz thimble. Indeed, the complex Langevin process 
reproduces analytic results as expected. 

These two models may give insights to improve the 
complex Langevin processes. To be specific, it is sug¬ 
gested that the complex Langevin processes can be cured 
by modifying the partition function so that the process 
is interpreted as an importance sampling on a single Lef¬ 
schetz thimble. On the other hand, it seems hopeless to 
find such modifications for more complicated models. In 
particular, in the derivation of the regular cosine model, 
the added integral 0 = 1 /_^ dx sin xe^ ^ is apparently 
fine-tuned so that the partition function consists of one 
Lefschetz thimble. 

In the following, we generalize the procedure to con¬ 
struct a theory with single-thimble structure and give an 
example to test our idea. 


IV. MODIFICATION OF LEFSCHETZ 
THIMBLES 

We propose a method to modify an original theory to 
the theory with a single Lefschetz thimble. Let us con¬ 
sider a partition function which has the following form; 

Z = Z[f{x)]= [ dxf{x)e-^-^-\ (7) 

J Do 

where Dq is a domain of integration. We assume that 
Dq have a finite width. The total action is given by 
S = Sq — log / and the quenched part Sq is assumed to 
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be real. We define the modification of Z by 

Z[f + g]=f dx{f{x) + (8) 

Jdo 

g is an arbitrary holomorphic function. We also define 
the quenched partition function Zq = Z[f = 1]. One can 
verify the following identity for an arbitrary observable 
o(xy, 


lp)z = - (O)zbi) (9) 

{O)^ denotes the expectation of O for a partition func¬ 
tion Z] 


^ J dxO{x)f{x)e 
^ f dxf{x)e~^^^^'> 


( 10 ) 


Expectation values for the modified and quenched parti¬ 
tion functions are defined in the same way. Thus, any ex¬ 
pectation values of the original theory can be computed 
from the modified and quenched theories. In particu¬ 
lar, {f)^ and (g)^ are calculable on the basis of the 
ordinary Langevin method or the Monte Carlo simula¬ 
tion because the Sq is supposed to be real. Remarkably, 
Eq. (|^ holds in a higher dimensional case as well as the 
present one-dimensional integral. 

It is worth to mention a case where (g) ^ = 0. In such 
a case, {f)^ never contribute to the {O)^ even when the 
sign problem is severe, or {f)^ is hard to compute by 
the Monte Carlo simulation. The regular cosine model 
discussed around Eq. § is an example of such a modifi¬ 
cation. We also emphasize that our modification method 
does not need to eliminate the logarithmic terms from the 
original model like the case of the regular cosine model. 

For the sake of later discussion, we give a useful iden¬ 
tity which is rather simpler than Eq. 0- This identity 
is obtained by the replacement g(x) —>■ ig{x), where the 
new g{x) is holomorphic, and takes only real values on 
the real axis. For such a restricted class of g and real 
function O, we find 


{0)z = Re{0)^ 



lm(0)^. 


( 11 ) 


Here Z denotes Z[f + ig]. As will see below, this simpler 
identity is sufficient to get a single-thimble theory in the 
case of the cosine model. 

The next step to see is how the function g{x) modifies 
the Lefschetz thimbles of the original theory. The shape 
of Lefschetz thimbles is characterized by fixed and singu¬ 
lar points which are the starting and ending points of the 
steepest descent path. The fixed point Zf and the singu¬ 
lar point Zs of the modified theory Eq. Q are obtained 
by the following equations: 


f{zs) + ig{zs) = 0, 


( 12 ) 



riz)+zgyz) \ 

f{z) + ig{z) ) 


= 0 , 

2=2/ 


(13) 


where primes denote the derivative with respect to z. In 
general, it is difficult to find all the solutions of Eqs. (12) 
and (13) for an arbitrary g{x). To avoid the difficulty, 
we introduce a real and positive parameter r and replace 
g{z) by Tg{z). When t = 0, one reproduces the origi¬ 
nal partition function Eq. ([^. The location of the fixed 
and singular points are described by the following evolu¬ 
tion equations which are much easier to solve Eqs. (12) 
and (lIS): 


dzs _ -igjzs) 

dr f'{zs) +iTg'{zs)’ 

dzf d f _ f(.z) +iTg'{z) \ 

dr dz\ ^ f{z) + iTg{z) j 


(14) 

(15) 


Equation (141 is also useful to determine a form of g{z) 
which leads singe-thimble structure. If there are singular 
points in the domain of the complex action S{z) and they 
are the endpoints of relevant thimbles, there are more 
than two thimbles. The necessary condition for single¬ 
thimble structure to achieve is that the singular points 
are located outside or on the boundary of the domain. 
Since a zero of g{z) is a fixed point of Eq. (14), the zero 
of g{z) is a singular point of the modified model for a 
sufficiently large r. Therefore, g{z) should have zeros 
outside or on the boundary of the domain. 

While this is a criterion for choosing g{z), it does not 
always guarantee that the modified model consists of a 
single Lefschetz thimble. Specifically, zeros of g{z) are 
not necessarily the endpoints of relevant thimbles. It 
should be confirmed for each g(z) whether single-thimble 
structure is achieved or not in the modified model. 


V. APPLICATION TO THE COSINE MODEL 

In this section, we apply the modification method to 
the cosine model, namely, f{x) = cosx, Sq = — j3 cos x 
and Dq = [—TT, tt] in Eq. (1^. The domain of the complex 
action S{z) is given by iRezj < tt. As we can see in 
Fig. [3 the cosine model has the multi-thimble structure 
for fd = 0.5. The multi-thimble structure is caused by 
the two singular points, z = ±7r/2 because they are the 
endpoints of the relevant thimbles. 

In order to achieve single-thimble structure, it is nec¬ 
essary that the relevant thimble starting from the origin 
has the endpoints outside or on the boundary of the do¬ 
main |Rez| < TT. When we impose (/(Ttt) = 0, the mini¬ 
mal choice of g{z) is given by g{z) = [z — tt){z -\- tt). In 
Fig.i we show the evolution of the singular and fixed 
points from r = 0 to 1 for jd = 0.5. The endpoints of 
the thimble of the original model at z = ±7r/2 leave from 
the real axis while the singular points at z = ±37r/2 
move towards z = ±7r. We also show the Lefschetz thim¬ 
bles at T = 1 in Fig. [3 Only the thimble starting from 
the origin is relevant, and it ends at z = ±7r as we ex¬ 
pected. Of course, g{z) is not unique and other choices 
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of g{z) can lead single-thimble structure, for example, 
g{z) = {z — 27r)(z -I- 27r). We have also confirmed that 
the integration contour of the modified model consists of 
one thimble for that case. In the following, we employ 
g{z) = (z — Tr)(z + tt) and t = 1 to perform the complex 
Langevin simulation. 
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FIG. 3. (top) The evolution of fixed and singular points 
for d = 0.5. Each point is plotted for r = 0 and 1. The 
function g{z) is taken as g(z) = (z — tv)(z + tt). (bottom) 
The Lefschetz thimbles at r = 1. The sampled configurations 
of the complex Langevin process are plotted for the periodic 
boundary condition. 
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The complex Langevin equation of the modified model 
is solved by the usual Euler scheme. Because g{z) = 
{z—Tr){z+Tr) breaks the periodicity of the original model, 
we use the periodic and box boundary conditions so that 
configurations are sampled in the domain |Rez| < tt. 
In the box boundary condition, the drift term is mod¬ 
ified to add the repulsive barrier at the boundary of the 
area. The drift term including the repulsive force is given 
by dS/dz — (5(Rez — tt) -|- i5(Rez -I- tt). The time slice is 
At = 10“'^ and the total Langevin step is N = 10®. We 
use an adaptive time step |14j to stabilize the numerical 
simulation. {f)z^ {g)z^ measured by the Monte 

Carlo integration. We measure the expectation value of 
cosnx by utilizing Eq. (11). 


Eigure ^ shows the value of Re {cos nz) ^ as a function 
of /?. The expectation values measured by the modi¬ 
fied model well agree with the analytic results Eq. 
within the statistical error. Specifically, the 1//3 behav¬ 
ior of (cosx)^ in the small j3 region is clearly reproduced 
while the complex Langevin dynamics of the original co¬ 
sine model fails. We confirmed that the choice of the 
boundary conditions does not affect the result. 
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FIG. 4. The expectation values of Re(cosna :)2 computed 
from original (denoted by square points) and modified cosine 
models. For the modified model, the results are shown for box 
and periodic boundary conditions (pbc). The analytic results 
Eq. (§ are plotted by solid lines. 

Finally, we discuss the distribution obtained by the 
complex Langevin process for the modified model. Fig¬ 
ure shows the histogram of configurations sampled by 
the complex Langevin process with the periodic bound¬ 
ary condition for = 0.5. Since the origin is the at¬ 
tractive point under the Langevin dynamics, the config¬ 
urations are manifestly distributed around the Lefschetz 
thimble. The choice of the boundary condition does not 
change the shape of the distribution qualitatively. 

Concerning the validity of the complex Langevin dy¬ 
namics, we should mention the role of singular points at 
z = ±7r. In Refs. [201122) . it was argued that the failure 
of the complex Langevin dynamics may be attributed to 
the presence of singular points. Nevertheless, we find 
that the expectation values are correctly measured while 
the distribution seems to overlap the singular points. 



VI. CONCLUSIONS 

We have developed a way to improve the complex 
Langevin dynamics by modifying the structure of Lef¬ 
schetz thimbles. The desirable modification can be 
found by manipulating the locations of fixed and singular 
points. We have applied our method to solve the cosine 
model in which a severe sign problem arises to test its va¬ 
lidity. As a result, it has been found that the expectation 
value can be correctly measured by the complex Langevin 
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FIG. 5. The distribution obtained by the complex Langevin 
process. 


fixed points can contribute to the partition function, and 
therefore, it consists of multi-thimbles. Even in the situ¬ 
ation, one can manipulate the structure of the Lefschetz 
thimbles such that only one thimble is relevant. It is 
also interesting to find a modification function g(x) which 
holds {gix))z^ — 0 and achieves an importance sampling 
on a single Lefschetz thimble in more complicated mod¬ 
els. In such a case, the expectation value measured in 
the original model {0{x)) can be obtained without cal¬ 
culating {f(x)) 2 ;^ appearing in Eqs. and ( [TT| ) which 
is hard to compute reliably in systems with a severe sign 
problem. 

Other important issues are higher dimensional prob¬ 
lems where the structure of Lefschetz thimbles is more 
complicated. To develop more systematic ways to find 
an appropriate modification is work in progress. 


process when the modified partition function consists of 
a single Lefschetz thimble and the process achieves the 
importance sampling on it. 

One of the most interesting application of our method 
is dealing with phase transitions. In the vicinity of a 
transition line, both perturbative and nonperturbative 
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